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(57) Method and apparatus for picture coding and 
method and apparatus for picture decoding are 
disclosed, wherein an apparatus for picture 
coding comprises : 

means for receiving and storing picture 
data composed in frames, 

activity calculating means for calculating 
the activity of the picture data in every frame, 

frame/field coding judging means for re- 
ceiving the activity, and Judging to perform 
frame unit coding when the activity is over a 
specific value or to perfonn field unit coding by 
dividing a frame into fields when the activity is 
beiow a specific value, and 

coding means for coding in frame unit or 
coding in field unit concerning the picture data 
on the basis of the judgement, and Issuing a 
coded picture signal containing the frame/field 
coding Judgement signal. 

whereby picture coding of high efficiency 
is realized despite magnitude of motion, by 
coding in field unit when the motion of picture 
is large, and coding In frame unit by making use 
of the vertical correlation of picture when the 
motion is small. 
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The invention relates to method and apparatus for picture coding and method and apparatus for picture 
decoding, and more particularly to method and apparatus for picture coding and method and apparatus for 
picture decoding of high efficiency effective for transmission or recording of digital images. 

The transfer rate of digital image reaches hundreds of Mbps to several Gbps. and processing of digital 
5 image is restricted by the communication costatthe time of transmission, and limited by the recording capacity 
of the recording apparatus at the time of recording. It has been accordingly attempted to develop method and 
apparatus for picture coding capable of minimizing the deterioration of picture quality and lowering the transfer 
rate at the same time. 

As one of such picture coding methods, the motion compensation interf rame differential two-dimensional 
10 discrete cosine transform (DCT) of the CCIR H.261 standard is described below. 

Fig. 8 is a block diagram of motion compensation interf rame differential two-dimensional DCT In Fig 8 
numeral 101 denotes a DCT circuit. 102 is a quantizer. 103 is an inverse quantizer. 104 is an inverse DCT 
circuit, 105 IS a frame memory, 106 is an interframe motion compensation circuit, 107 is an interframe motion 
detection circuit. 108 is an intraframe/interf rame changeover circuit, and 1 09 is a variable length coding circuit. 
15 In this conventional picture coding apparatus, the operation is as follows. 

The input is an interlaced image called common intermediate format (CIF). Fig. 9 is a time-space config- 
uration of pixels of input picture, in which the axis of abscissas denotes the time direction and the axis of or- 
dinates represents the vertical direction or the line direction. In the diagram, a set of pixels equal in the time 
axis IS called a CIF frame, and coding is performed in the unit of CIF frame. 

The first frame of coding, that is. the picture of frame t is changed over to intraframe coding by an intra- 
frame/interf rame changeover signal 108. and is subjected to intraframe coding vinthout considering the dif- 
ference. That IS, the image data is converted into a transform coefficient in the DCT circuit 101 in the unit of 
two-dimensional block, and the transform coefficient is quantized in the quantizer 102, and is subjected to 
variable length coding in the variable length coding circuit 109. and is sent out into a transmission route Gen- 
erally, the picture is high in correlation, and. as a result of DCT. the energy is concentrated in the transform 
coefficient corresponding to the low frequency components. Therefore, by quantizing coarsely the high fre- 
quency components which are less obvious visually, and finely the low frequency components which are im- 
portant components, the picture quality deterioration is kept to a minimum, and the quantity of data can be 
decreased at the same time. The transform coefficient after quantizing is simultaneously returned to the real 
time data via the inverse quantizer 103 and inverse DCT circuit 104. and accumulated in the frame memory 

On the other hand, the pictures after frame (t+1 ) are subjected to interframe differential coding in each 
frame. First, in the motion detection circuit 107. by emptoying, for example, the well-known full search method 
the interframe motion vector is determined in every two-dimensfohal block. The interframe motion compen- 
sation circuit 106 generates, making use of the detected motion vector, a predicted value compensating the 
motion of the nextframe in the unit of two-dimensional block. The picture of frame (t+1) is compared with the 
predicted value generated from frame t in the above method, and the difference or prediction error is calcu- 
lated. Afterwards, the prediction error is coded in the same manner as in frame t. After frame (t+2) the pre- 
diction error is coded in the same nranner as in the method of frame (t+1). According to this method, since 
the prediction error is coded, as compared with the case of directly coding the image data as in the intraframe 
coding, the energy decreases, and more efficient coding is enabled (for example, refer to CCITT Recommen- 
dation H.261. "Codec for audiovisual services at px 64 kbit/s,* Geneva, 1990). 

In this picture coding method, however, the picture input by interlaced scanning cannot be coded efficient- 
ly. The reason is explained by reference to Figs. 10. 11. and 12. The pictures generally used at the present 
are scanned by interlacing. Fig. 10 is a time-space configuration of pixels of interlaced picture. Figs 11 and 
12 explain examples of display of interlaced picture in frame, without motion in Fig. 11. and with a horizontal 
motion in Fig. 12. 

Pixels are disposed at positions deviated in time in every one vertical line by interlacing. In Fig 10 a set 
of pixels equal in the time axis is called a field, and two fields differing in the time axis are put together to 
form a frame, and one frame is composed of field 1 and field 2. Without motion, as shown in Fig 11 the frame 
picture IS an image of high vertical correlation. With motion involved, the frame picture is deviated by the 
amount of interf ield motton in every field, that is, in every line as shown in Fig. 12. Therefore, it is efficient to 
code in the unit of frame in the absence of motion, but in the presence of motion, if coded in the frame unit 
a high frequency component in the vertical direction corresponding to the field difference occurs, which caus^ 
es deterioration of picture quality, and it is hence preferred to employ the conventional image coding method 
in the field unit. The problem was that the optimum coding method varied depending on the motion that is 
coding in the frame unit in the case of small motion and coding in the field unit in the case of large motion ' 
It IS hence a primary object of th invention to present method and apparatus for picture coding and meth- 
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od and apparatus for its decoding of high efficiency capable of executing optimum coding despite magnitude 
of motion of picture. 

To achieve the object, one of the preferred embodiments of the invention comprises: 
means for receiving and storing picture data composed in frames, 
5 activity calculating means for calculating the activity of the picture data in every frame. 

frame/field coding judging means for receiving the activity, and judging to perform frame unit coding 
when the activity is over a specific value or to perform field unit coding by dividing a frame into fields when 
the activity is below a specific value, and 

coding means for coding in frame unit or coding in field unit concerning the picture data on the basis 
10 of the judgement, and issuing a coded picture signal containing the frame/field coding judgement signal, 

whereby picture coding of high efficiency is realized despite magnitude of motion, by coding in field unit 
when the motion of picture is large, and coding in frame unit by making use of the vertical correlation of picture 
when the motion is small. 

Further objects and effects of the invention will be better understood and appreciated in the following de- 
ls tailed description. 

Fig. 1 is a block diagram of a first embodiment of a picture coding apparatus according to the invention. 
Fig. 2 is an explanatory diagram of coding in frame unit and coding in field unit of the invention. 
Fig. 3 is a block diagram of activity calculating circuit 1 and frame/field coding judging circuit 2 in Fig. 1. 
Fig. 4 is a flow chart showing processing in frame/field coding judging circuit of the invention. 
20 Fig. 5 is a flow chart showing processing in frame/field coding judging circuit in a second embodiment of 

the invention. 

Fig. 6 is a block diagram of a third embodiment of picture coding apparatus according to the invention. 
Fig. 7 Is a block diagram of an embodiment of a picture decoding apparatus according to the invention. 
Fig. 8 is a block diagram of a conventional motion compensation interframe differential two-dimensional 
25 DCT. 

Fig. 9 is a time-space configuration diagrarn of pixels of CIF. 

Fig. 10 is a time-space configuration diagram of pixels of interlaced picture; 
Fig. 11 is an explanatory diagram of frame picture without motion. 
Fig. 12 is an explanatory diagram of frame picture with motion. 
30 Referring now to drawings, a first embodiment of method and apparatus for picture coding according to 

the invention is described below. 

Fig. 1 is a block diagram of a picture coding apparatus according to the first embodiment of the invention. 
Fig. 2 is an explanatory diagram of coding in frame unit and coding in field unit. Fig. 3 is a block diagram of 
activity calculating circuit and frame/field coding judging circuit in Fig. 1, and Fig. 4 is a flow chart showing 
35 pn^cessing in frame/field coding judging circuit 2. In Fig. 1 , numeral 1 denotes an activity calculating circuit, 
2 is a frame/field coding judging circuit. 3 is a coding circuit. 4 is a frame memory, and 5 is a coded picture 
output terminal. 

The image coding apparatus in Fig. 1 is explained by reference to Figs. 1, 2, 3 and 4, 
The input picture in frame unit is stored in the frame memory 4, and at the same time the frame block 
40 activity Ar and field block act ivity Ai are calculated in the activity calculating circuit 1 . This activity is calculated, 
for example, as follows. The input picture is divided into two-dimensional small blocks, and sequentially nunv 
bered in the frame unit as shown In Fig. 2 (a), as frame small block Sbr (x.y) (x: horizontal pixel address, 1 ^x^8. 
y: vertical pixel address. l^y^B), and sequentially numbered in the frame unit as shown in Fig. 2 (b), as picture 
data of field small block Sbi (x.y.n) (x: horizontal pixel address. 1^x^8. y: vertical pixel address. 1^y^4. n: 
45 small block address 1 ^n^2). Consequently, adding the energy sum of interline difference of every line in each 
block, the frame and field block activities are obtained. They are expressed in the following equations. 
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[Formula 1] 

5 

8 8.2 

Ar = X Z ( Sbr(x, y+1) - Sbr(x. y) ) 2 
x=l y=l 
2 8 4.2 

= X Z Z (Sbi(x,y+l,n)-Sbi(x,y.n)) 2 

n=l x=l y=I 

Fig. 3 is an example of activity calculating circuit 1 , which comprises a buffer memory 1 1 for dividing the 
15 input picture into two-dimensional small blocks, an address generating circuit 12 for generating its address, 
first and second square error calculating circuits 13. 14 for calculating square errors or Ar. Ai. and a multiplexer 
1 5 for multiplexing and issuing Ar, Ai. 

Thus obtained block activities are fed into the frame/field coding judging circuit 2. In Fig. 3, the frame/field 
coding judging circuit 2 is composed of central processing unit (CPU). Reference is made to Fig. 4 which shows 
20 the operation of the CPU. The input frame activity Ar and field activity Ai are compared in magnitude in every 
two-dimensional block, and the number a of blocks of Ai>Ar in one frame is calculated. Next, a is compared 
with an experimentally determined value T1, and if a ^T1, a change-over signal showing frame coding is is- 
sued, and if a <T1, a changeover signal showing field coding is issued, in every frame. 

In the case of small motion, since the correlation of vertical pixels is high, the relation is Ai>Ar. In the case 
25 of large motion, to the contrary, the difference between different fields is large, and it is Ai<Ar. Therefore, when 
T1 is set as 1/2 of the number of blocks in one frame, for example, by comparing Ar and Ai in every block, 
when the number of blocks a of Ai>Ar occupies the majority in one frame, that frame Is judged to be efficient 
in coding in frame unit. To the contrary, if the number of blocks satisfying Ar>Ai is many, coding in field unit 
is judged to be appropriate. Herein, coding in frame unit and field unit is coding or decoding in the unit of frame 
30 in terms of the time, or in the unit of field, as shown in Fig. 2 (a), (b), respectively. In the frame unit, field 1 
and field 2 of time t must be coded and decoded simultaneously, but in the field unit, on the other hand, field 
1 and field 2 of time t are coded and decoded at separate times. 

The coding circuit 3 employs, for example, a motion compensation interf rame differential two-dimensional 
OCT circuit In the prior art, and a motion compensation interf ield differential two-dimensional OCT circuit ap- 
35 plying the prior art in the field unit. The main difference between the motion compensation interframe differ- 
ential two-dimensional DCT circuit and the motion compensation interfield differential two-dimensional DCT 
circuit are whether the object of coding is the block in frame unit as shown in Fig. 2 (a) or the block in field 
unit as shown in Fig. 2 (b). and whether the motion detection and motion compensation are frame interval or 
field interval. Therefore, the difference in circuit lies only in the motion detection circuits 107, 117, and motion 
40 compensation circuits 106, 116. 

If the result of judgement by the frame/field coding judging circuit 2 is coding in frame unit, the frame mem- 
ory 4 issues a frame block. In the coding circuit 3, changing over the switch, the frame unit block is fed into 
the motion compensation interframe differential two-dimensional DCT circuit, and at the same time, the input 
of the variable length coding circuit 109 is changed over to the quantizer 102 in the motion compensation in- 
45 terframe differential two-dimensional DCT circuit. In the case of coding In field unit, in the same operation as 
in the frame unit, the block in the field unit Is coded. 

The result of judgement by the frame/field coding judging circuit 2 is sent out from the output terminal 5, 
together with the coded picture signal, through the variable length coding circuit 109. 

In this picture coding apparatus, when the interframe correlation is higher than the interfield correlation, 
50 it follows that a ^T1. and interframe coding is selected, and in the reverse case, the interfield coding is se- 
lected, thereby realizing optimum coding adaptively to the magnitude of the motion. 

Fig. 5 Is a flow chart showing processing in the CPU of the frame/field coding judging circuit 2 in a second 
embodiment of the inv ntion. What differs from the first embodiment Is that the frame coding and field coding 
are not changed over in every frame, but only once in every N frames. When the number of blocks a of Ai>Ar 
55 satisfies the condition of a ^T1, the pointer p showing how many frames have satisfied a ^T1 is added. At 
the end of N frames, the pointer p is compared with an experimentally determined value T2 (for example T2 
= N/2), and if p ^T2, a changeover signal showing frame coding is issued, and if p <T2. a changeover signal 
showing field coding is issued. 
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Usually, in Interframe differential coding, in order to prevent error propagation, intraframe coding is in- 
serted in a specific period. In the second embodiment, the period of Intraframe coding is regarded as N frames, 
and the coding in frame unit and coding in field unit are changed over in the intraframe coding period N. Ac- 
cordingly, changeover of coding occurs only in N frame periods, and the load of the hardware can be alleviated. 
5 Besides, If coding in frame unit and in field unit is frequency changed over in every frame, the picture quality 
may fluctuate, but it is changed over in every N frames in the second embodiment, so that fluctuation of picture 
quality may be avoided. 

In the second embodiment, it is judged by the number of times p occurring in N frames, but In order to 
further avoid fluctuations of picture quality, it may be also possible to set to change over if occurring x times 

10 continuously. In usual pictures, it is very rare that a moving part and a slow moving part are changed over in 
every frame, but a picture continues for several frames or several seconds. Therefore, by setting N = 15, x = 
8, that is. by changing over coding in frame unit or coding in field unit when the majority conforms to the con- 
dition continuously during 0.5 sec, a sufficient performance is obtained. 

In the foregoing embodiments, the block activities Ar, Ai are determined by the difference between the 

15 lines, but it is not limitative, and for example, it may be the sum of the AC energy of frame and field blocks. 
That is. using Sbr, Sbi in the first embodiment, first the mean values of each small block mr, mi(n) are deter- 
mined. Then, using mean values mr, mi(n), the AC energy of each small block is determined, and the sum of 
AC energies of smalt blocks is calculated to obtain Ar, Ai. They are expressed in the following equations. 

20 

[Formula 21 



8 8 

mr = X X Sbr(x, y) 

x=l >r=l 

8 8 

Ar = X Z (Sbr(x.y). mr)2 

8 4 

mi(n) = -L- X Z Sbi(x. n) 

x=l y=l 

2 8 4 

Ai = Z Z Z ( Sbi(x, y, n) - mi(n) )^ 

n=l x=l y=i 

Judgement of coding in frame unit and coding in field unit is done on the basis of the total number of blocks 
40 conforming to the conditions by comparing Ai and Ar in each block, but it is not limitative, and the entire picture 
may be regarded as one block, and comparison of Ai>Ar is determined only once in every frame, and it is judged 
on the basis of the result, so that same effects may be obtained. 

In comparison of block activities Ai, Ar, it is judged at AI>Ar in the foregoing embodiments, but by adding 
an offset it is also possible to judge at (Ai ^ offset) > Ar. Generally, frame unit coding is more efficient than 
45 field unit coding, and hence by judging with offset it is possible to increase the frequency of frame unit coding. 

In the first and second embodiments, the initial value of coding may be either frame unit coding or field 
unit coding, but in general picture, small movements are in majority, and it may be set at frame unit coding. 

Fig. 6 is a block diagram of a third embodiment of a picture coding apparatus of the invention. What differs 
from the second embodiment is the constitution of the coding circuit. (In Fig. 6, the coding circuit is indicated 
50 by numeral 30.) In the second embodiment, the motion compensation interframe differential two-dimensional 
DCT circuit and motion compensation interf ield differential two-dimensional OCT circuit are changed over by 
the output of the coding judging circuit 2, but in the third embodiment, the output of the coding judging circuit 
2 is fed into an interf rame/interf ield prediction circuit 126, and it is designed so as to be capable of changing 
over the motion compensation not only in the block unit but also in the entire picture, so that the coding circuit 
55 may be composed of the smaller hardware than in the second embodiment. 

Fig. 7 is a block diagram of an embodiment of picture decoding apparatus of the invention. The apparatus 
in Fig. 7 comprises a frame/field decoding changeover circuit 6. a decoding circuit 7, a coding image input ter- 
minal 8. and a picture output terminal 9, and operates as follows. The coded picture input is fed into a variable 
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length decoding circuit 139 inside the decoding circuit 7. and is separated into the picture data and frame/field 
coding judging signal. The frame/field decoding changeover circuit 6 receives the frame/field coding judging 
signal determined by the activity from the variable length decoding circuit 139, and sends the frame/field de- 
coding changeover signal to the decoding circuit 7. The decoding circuit 7 processes the picture data by inverse 
quantizing and inverse DCT, and compensates the motion in frame unit or field unit depending on the change- 
over signal in each circuit, reproduces the picture, and issues the decoded picture in frame unit or field unit 
selected by the changeover signal. Therefore, by the picture decoding apparatus shown in Fig. 7. the picture 
having being coded by the foregoing embodiments can be decoded. 

In the embodiment in Fig. 7. the motion compensation prediction circuit is composed of different circuits 
in every frame orf leld, but it is also possible to simplify by using the motion compensation interf rame/lnterf ield 
prediction circuit as shown in Fig. 6. 

In these embodiments, as the example of coding circuit, the motion compensation interf rame differential 
DCT circuit is explained, but it is not limitative, and Hadamard transform, Fourier transform, other orthogonal 
transform circuits, vector quantizing circuits, and any other means having the function of coding the image 
can be similarly employed. 

The invention may be embodied in other specific forms without departing from the spirit or essential char- 
acteristics thereof. The present embodiments are therefore to be considered In all respects as illustrative and 
not restrictive, the scope of the invention being Indicated by the appended claims rather than by the foregoing 
description and all changes which come within the meaning and range of equivalency of the claims are there- 
fore intended to be embraced therein. 



Claims 



1 . A method for picture coding comprising: 

a step of feeding picture data composed of one frame, 

a step of calculating the activity of the picture data in every frame, 

a step of comparing the activity with a specific value, and judging to perform frame unit coding 
when larger than a specific value, and to perform field unit coding by dividing a frame into fields when 
the activity is below a specific value. 

2. A method for picture coding of claim 1, wherein the step for calculating the activity Is to divide the input 
picture data into one or more two-dimensional blocks, compare the field block activity calculated in field 
unit and the frame block activity calculated in frame unit, and issue the number of blocks with the field 
block activity larger than the frame block activity as calculation output of the activities. 

3. A method for picture coding of claim 1, wherein the step of changing over between frame unit coding and 
field unit coding Is to change over when the activity is more than or below a specific value continuously 
in plural frames. 

4. A method for picture coding of claim 1 . wherein the step of changing over between frame unit coding and 
field unit coding is to change over with at least one of the predetermined plural changeover points. 

5- An apparatus for picture coding comprising: 

means for receiving and storing picture data composed in frames. 

activity calculating means for calculating the activity of the picture data in every frame. 

frame/field coding judging means for receiving the activity, and judging to perform frame unit cod- 
ing when the activity is over a specific value or to perform field unit coding by dividing a frame into fields 
when the activity is below a specific value, and 

coding means for coding in frame unit or coding in field unit concerning the picture data on the 
basis of the judgement, and issuing a coded picture signal containing the frame/field coding judgement 
signal. 

6. A method for picture decoding comprising: 

a step of receiving a coded picture signal and extracting a frame/field coding judging signal from 
the coded picture signal input. 

a step of issuing a signal for changing over decoding action in frame unit or field unit depending 
on the frame/field coding judging signal, and 
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a step of decoding the coded picture signal in frame unit or field unit according to the changeover 

signal. 

An apparatus for picture decoding comprising: 

means for receiving a coded picture signal and extracting a frame/field coding judging signal from 
the coded picture signal input, 

frame/field decoding changeover means for issuing a signal for changing over decoding action in 
frame unit or field unit, and 

decoding means for decoding the coded picture signal in frame unit or field unit according to the 
changeover signal. 
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Fig. 4 
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Fig. 5 
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Fig. 8 
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